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Nonlinear Model Predictive Control of A Gasoline 
HCCI Engine Using Extreme Learning Machines 

Vijay Manikandan Janakiraman, XuanLong Nguyen, and Dennis Assanis 


Abstract —Homogeneous charge compression ignition (HCCI) 
is a futuristic combustion technology that operates with a high 
fuel efficiency and reduced emissions. HCCI combustion is char¬ 
acterized by complex nonlinear dynamics which necessitates a 
model based control approach for automotive application. HCCI 
engine control is a nonlinear, multi-input multi-output problem 
with state and actuator constraints which makes controller design 
a challenging task. Typical HCCI controllers make use of a first 
principles based model which involves a long development time 
and cost associated with expert labor and calibration. In this 
paper, an alternative approach based on machine learning is 
presented using extreme learning machines (ELM) and nonlinear 
model predictive control (MFC). A recurrent ELM is used to 
learn the nonlinear dynamics of HCCI engine using experimental 
data and is shown to accurately predict the engine behavior 
several steps ahead in time, suitable for predictive control. Using 
the ELM engine models, an MFC based control algorithm with 
a simplified quadratic program update is derived for real time 
implementation. The working and effectiveness of the MFC 
approach has been analyzed on a nonlinear HCCI engine model 
for tracking multiple reference quantities along with constraints 
defined by HCCI states, actuators and operational limits. 

Index Terms —Recurrent Neural Networks, Extreme Learning 
Machines, Model Fredictive Control, Nonlinear MFC, Nonlinear 
Identification, Engine Control, Control Model, Homogeneous 
Charge Compression Ignition, HCCI Engine. 


1. Introduction 

In recent years, the requirements on automotive perfor¬ 
mance, emissions and cost have become increasingly stringent. 
As a consequence, the auto industry has been continuously 
introducing efficient mechanisms to meet these demands m. 
Invariably, such systems introduce additional complexity and 
associated challenges in design and implementation. Homo¬ 
geneous charge compression ignition (HCCI) is an advanced 
combustion technology incorporating several of the recent 
automotive advancements including variable valve timing, 
exhaust gas recirculation, intake charge boosting etc Ill. HCCI 
engines shifted the spotlight from traditional spark ignited (SI) 
and compression ignited (Cl) engines owing to its ability to 
reduce emissions and fuel consumption significantly O, O. 
However, HCCI poses several challenges for implementation. 
These include the absence of a direct trigger for combus¬ 
tion, narrow operating range and high sensitivity to ambient 
conditions amongst others. Control of HCCI combustion is a 
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challenging problem and a model based approach is typically 
employed H, ID, where a control-oriented reduced order 
model is developed using first principles. Such models involve 
a long development time and cost associated with expert labor 
and calibration. To accelerate HCCI implementation on auto¬ 
motive applications, a key requirement is to develop predictive 
dynamic models quickly that can not only capture the required 
dynamics for control but also operate under limited resources, 
for instance, onboard an engine electronic control unit (ECU) 
whose memory and computation are limited. 

In order to enable the complex control strategies, the HCCI 
engine is equipped with additional sensors such as in-cylinder 
pressure transducers that can provide valuable operational 
data. In-cylinder pressure data can give insights into the gen¬ 
eral combustion behavior of an engine, including efficiency, 
emissions and stability. Although the primary use is to observe 
the states of the engine for feedback control O, d, such 
sensory information can be processed to develop dynamic 
models of the system itself. It has been previously shown by 
the authors that in-cylinder pressure data can be used to de¬ 
velop control oriented models of engine combustion phasing, 
work output, combustion stability using neural networks m 
and support vector machines (9), Col. This article considers 
controller design for HCCI engine using data based models. 
Control systems using machine learning models are popular 
in robotics, autonomous and aerospace systems ifTTIl . ifT^ 
but less popular in the automotive industry. However, with 
increase in complexity of emerging systems and with advanced 
sensing capabilities, there is a significant need to identify 
new venues and evaluate the potential of information based 
models for automotive control applications. This forms the 
main motivation of the interdisciplinary research considered 
in this article. 

For the HCCI modeling problem, Extreme Learning Ma¬ 
chines (ELM) were selected for their fast operation and 
approximation capabilities to fit nonlinear systems ifTSll . Also, 
when ELM is trained with real world experimental data, it 
approximates the real system and makes no (or minimal) 
simplifying assumptions about the underlying phenomena. The 
dynamics of sensors, actuators and other complex processes 
which are usually overlooked/hard to model using first prin¬ 
ciples, can be captured using the identification method. In 
addition, for a system like the combustion engine, prototype 
hardware is typically available and extensive experimental 
data can be collected making the data based approach more 
appropriate. Data based identification is less common for 
HCCI engines owing to its nonlinear, highly sensitive and 
unstable behavior. However, it has been shown previously 
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by the authors that artificial neural networks lO and support 
vector machines 0 are indeed suited for accurately predicting 
the dynamics of HCCI. However, artificial neural networks 
(based on backpropagation) have issues with picking up a 
local minima while support vector machines result in a large 
number of parameters making it unsuitable for real engine 
implementations |[9l- ELMs on the other hand, solve a convex 
problem resulting in a global optimal solution and simple to 
be implemented onboard the engine ECU to make predictions. 

Eor the HCCI control problem, a model predictive control 
(MFC) framework is employed that can operate with black 
box models In addition, MFC is well suited for handling 
operation related and hardware related constraints in an elegant 
manner. Even for simple linear systems, MFC has been shown 
to perform well against traditional control such as FID ca, 
LQ control ca, ini etc. Typically, MFC makes use of a 
mathematical model of the system and solves an optimization 
problem with the given constraints to achieve an optimal 
control solution Ha. In this paper, a recurrent ELM engine 
model is used to make predictions which are then used by 
MFC to make control decisions for tracking a given reference 
command. Model predictive control has been quite popular in 
the automotive domain for both spark ignited Ga and com¬ 
pression ignited engines ca, 1(201. However, the application 
of MFC to HCCI engines is at an early stage involving physics 
based models 1211 . and simple identification models ||23l. 
This article advances the MFC application to HCCI engines 
by demonstrating on a data based non-linear model that could 
capture more complex behavior of the engine. 

The contributions of the article can be summarized as 
follows. An ELM based system identification framework is 
developed for modeling the HCCI engine from real experimen¬ 
tal data. This include optimal model selection (tuning model 
hyper-parameters), training and validation of the model to the 
HCCI engine data. An ELM based MFC framework is not re¬ 
ported in the literature to the best of the authors knowledge. A 
control oriented model of the gasoline HCCI engine predicting 
engine work output, combustion phasing, combustion stability 
in terms of maximum pressure and maximum pressure rise rate 
etc. is developed using ELM models and validated at several 
operating conditions. A model predictive control framework 
based on linearized ELM and a simplified quadratic program 
update is developed for the HCCI system suitable for real-time 
application. The article finally identifies the HCCI engine as 
a novel application domain for demonstration of the above 
methodologies in combination. 

The article is organized as follows. The HCCI engine 
experimental setup, design of experiments and data collection 
are summarized in section [I^ A system identification proce¬ 
dure using ELM is described in section III where predictive 
models are developed and validated using HCCI experimental 
data. A model predictive control algorithm using linearized 
ELM models is derived in section [Iv] where linearization is 
done using the structure of ELM to avoid numerical gradi¬ 
ent calculations. Einally, the ELM based MFC approach is 
demonstrated in simulations in section |V| A fast quadratic 
programming method is employed using the convex nature of 
the problem which enables real-time implementation of the 


controller. Simulation cases have been analyzed to understand 
the working and effectiveness of the proposed method. 

H. HCCI Engine System And Experimentation 

In this section, the HCCI engine basics, experimental setup 
and data collection strategy are described. Majority of this 
section has been adopted from ID and included in this article 
for completeness. The engine (specifications listed in Table 
is a 4 stroke, inline 4 cylinder gasoline engine with modifica¬ 
tions to enable HCCI operation, such as increased compression 
ratio, direct fuel injection, intake boosting and variable valve 
timing. A schematic of the experimental setup and instrumen¬ 
tation is shown in Eig. The sensors of the engine include a 
fast in-cylinder pressure transducer, thermocouples at several 
locations at the intake and exhaust manifold, cylinder runners 
etc. The engine is operated with natural aspiration, i.e., all 
experiments in this work involve no or negligible difference 
between intake and exhaust manifold pressures. 

TABLE I: Specifications of the experimental HCCI engine 


Engine Type 

4-stroke In-line 

Fuel 

Gasoline 

Displacement 

2.0 L 

Bore/Stroke 

86/86 mm 

Compression Ratio 

11.25:1 

Injection Type 

Direct Injection 

Valvetrain 

Variable Valve Timing with 
hydraulic cam phaser having 

119 degree constant duration 
defined at 0.25mm lift, 3.5mm peak 
lift and 50 degree crank angle 
phasing authority 

HCCI strategy 

Exhaust recompression 
using negative valve overlap 


A. HCCI Strategy 

HCCI operation is achieved using a recompression strategy. 
The engine is a discrete event system where one combustion 
cycle (720 deg crank angle) represents an event. A snapshot 
of the cylinder pressure trace of one combustion cycle along 
with valve events and fuel injection events are shown in Eig.|^ 
During every combustion cycle, three distinct control actions 
can be defined - the crank angle at intake valve opening (IVO), 
crank angle at exhaust valve closing (EVC) and crank angle 
at start of fuel injection (SOI). The valve events are measured 
in degrees after exhaust top dead center (deg eTDC) while 
SOI is measured in degrees after combustion top dead center 
(deg cTDC). It should be noted that the fuel mass (EM in 
mg/cyc) is injected in a region between EVC and I VO defined 
as the negative valve overlap (NVO). The fuel is injected early 
(during NVO of previous cycle) and given sufficient time to 
mix with air forming a homogeneous mixture. A large fraction 
of the exhaust gas from the previous combustion cycle (EGR) 
is retained to elevate the temperature and hence the reaction 
rates of the fuel and air mixture. The variable valve timing 
capability of the engine enables trapping suitable quantities 
of exhaust gas in the cylinder. The fuel-air mixture is given 
sufficient time to mix homogeneously and as it is compressed 
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Fig. 1: A schematic of the HCCI engine setup and instrumentation (only relevant instrumentation is shown). 


cTDC eTDC cTDC eTDC 



Fig. 2: The pressure trace of a HCCI combustion cycle show¬ 
ing cycle definition, actuator ranges of intake valve opening 
(IVO), exhaust valve closing (EVC), start of injection (SOI). 
The crank angle at data recording are also shown. 

during the compression stroke, auto-ignition occurs initiating 
combustion. Since the fuel is mixed homogeneously through¬ 
out the cylinder, combustion of the fuel-air mixture happens 
almost instantaneously, releasing heat and pushing the piston 
down performing work. More details on setup and operation 
of the HCCI engine can be found in (H, ifTOl . 

B. HCCI Inputs and Outputs 

HCCI combustion is dominated by chemical kinetics and 
is limited by stability constraints such as misfire and knock 
El, ES. To achieve a stable combustion, a right proportion 


of fuel, air and EGR is required for a given thermal condition 
of the engine. Eurther, the combustion must occur at the right 
instant during the expansion stroke (given by CA50) for high 
efficiency and low emissions. By varying the valve events, the 
quantity of EGR can be varied while EM and SOI can control 
the ignition delay that affects combustion phasing. Thus, the 
engine operation can be controlled using quantities such as 
EM, IVO, EVC and SOI. Other important physical variables 
that infiuence the performance of HCCI combustion include 
intake manifold temperature Tin, intake manifold pressure Pin, 
mass flow rate of air at intake min, exhaust gas temperature 
Tex, exhaust manifold pressure Pex, coolant temperature Tc, 
fuel to air ratio (EA) etc. 

The engine performance metrics can be defined as follows. 
The indicated mean effective pressure (IMEP) represents the 
work output from the engine and is a primary response variable 
to be controlled. Eor instance, the driver’s power demand 
can be interpreted as a change in desired IMEP command 
given to the engine controller. The second and most important 
performance metric is the combustion phasing indicated by 
the crank angle at 50% mass fraction burned (CA50). The 
CA50 is a key quantity that infiuences engine performance, 
efficiency, emissions and stability O, Q. Eurther, additional 
quantities that give an indication of the combustion stability 
such as maximum pressure {Pmax) and maximum pressure rise 
rate (Rmax) in a combustion cycle are considered performance 
metrics to be monitored. The equivalent fuel air ratio (EAER) 
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that indicates if the mixture in the cylinder is fuel rich or 
fuel lean is another important parameter to be monitored. 
For HCCI control discussed in this article, the control knobs 
such as FM, EVC and SOI are considered inputs while 
performance variables such as IMEP, CA50, Pmax^ Pmax^ 
engine torque and EAFR are considered outputs. The IMEP, 
CA50, Pmax and Rmax are calculated from the high speed in¬ 
cylinder pressure measurements. For further reading on HCCI 
combustion and related variables, please refer EH, M, IE). 

C. Experiment Design 

The goal of the experiments is to obtain dynamic data from 
the HCCI experimental setup for model development. This 
task falls into the category of nonlinear system identification 
Ell. In order to obtain sufficiently rich information from the 
system, the excitation signal must excite the system at all 
frequencies and amplitudes (281. Persistent excitation cannot 
be guaranteed for nonlinear systems (2^ but in practice, am¬ 
plitude modulated pseudo-random binary sequence (A-PRBS) 
signals have shown good identification performance (27l. Thus 
an A-PRBS signal exciting the engine at different amplitudes 
and frequencies is considered in this work. A set of transient 
experiments is conducted at a constant speed of 1800 RPM 
and naturally aspirated conditions using a feedback controller 
developed for HCCI using first principles (29l. An A-PRBS 
sequence of reference IMEP and CA50 are given as inputs 
to the feedback controller while the controller calculates the 
commands of FM, EVC and SOI to be given to the engine. The 
experiments are conducted and data recorded using specialized 
engine rapid prototyping hardware. The data is sampled using 
the AVL Indiset acquisition system where in-cylinder pressure 
is sensed every crank angle while IMEP, CA50, Pmax and 
Rmax are determined on a per-combustion cycle basis. A 
subset of the HCCI input and output sensor data can be shown 
in Fig. The data is processed, scaled and converted to 
the input format for ELM training. More details on HCCI 
combustion, experiments and data preprocessing can be found 
in (3, 0. 

HI. HCCI Engine Model Development Using 
Extreme Learning Machines 

A. Learning HCCI Dynamics using Recurrent Models 

Eor the HCCI engine system, both the inputs and the 
outputs of the engine are available as sensor measurements 
and naturally, supervised learning methods can be used. The 
HCCI engine is a nonlinear dynamic system and sensor 
measurements represent discrete time sequences. A nonlinear 
auto regressive model with exogenous input (NARX) (ZTll can 
be considered as follows 

y{k) = fNARx[u{k - 1), u{k-nu), y{k-l),y{k-ny)], 

( 1 ) 

where u{k) G and y{k) G represent the inputs and 
outputs of the system respectively, k represents the discrete 
time index, fNARx{-) represents the nonlinear function map¬ 
ping specified by the model, Uu, riy represent the number of 
past input and output samples required (order of the system) 



Engine Cycles Engine Cycles 


Eig. 3: A subset of closed loop experimental data showing the 
A-PRBS inputs and the measured engine outputs. 


while Ud and yd represent the dimension of inputs and outputs 
respectively. Let 

x{k) = [u{k - 1), ..,u{k - n„), y{k - 1), y{k - ny)f (2) 


represent the augmented input vector obtained by appending 
the input and output measurements from the system. The 
engine measurement sequence can be converted to the form 
of training data 

{(^ 1 , ^i), •••, {xn, yx)} ^ {^,y) (3) 


where N denotes the number of training samples, X denotes 
the space of the input features (Here A' = W^dnu+vany 
y = Ryd)^ The above conversion of system measurements to 
training data can be used to train a series-parallel model where 
the past inputs and outputs of the system (concatenated in x) 
is used for one-step ahead predictions (OSAP) i.e., given a set 
of measurements until time index k, the model predicts the 
output at time k-\-l (see equation 0 and Pig. |^. A parallel 
architecture on the other hand can be used to perform multiple 
step ahead predictions (MS AP) by feeding back the predictions 
of the OSAP model in a recurrent manner (see equation 0 
and Pig. ^). Eor further reading on series-parallel and parallel 
architectures, the reader is referred to 


y{k-\-l) = Inarx [^(^), u{k-nuPl),y{k), .., y{k-nyXl)] 

(4) 


— fN ARX^^ikP'^pred P)f->fVj{k RuP'^pred) •> 
y{k Tlpred f ): • • 5 Ry P Rpred^] • (3) 

The OSAP model is used for training as existing simple 
training algorithms can be used and once the model becomes 
accurate for OSAP, it can be converted to a MSAP model 
recursively in a straightforward manner. The MSAP model can 
be used for making long term predictions useful for predictive 
control discussed in section El 
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(a) Series-Parallel architecture for system identification. 
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(b) Parallel Architecture for system identification. 


Fig. 4 


B. Extreme Learning Machines 

Extreme Learning Machines is an emerging learning 
paradigm for multi-class classification and regression prob¬ 
lems Ca, ED and has outperformed some state of the art 
algorithms such as backpropagation neural nets, support vector 
machines etc. The highlight of ELM is that the training speed 
is extremely fast with superior generalization capabilities. The 
key enabler for ELM’s training speed is the random assign¬ 
ment of input layer parameters which do not require adaptation 
to the data. In such a setup, the output layer parameters can be 
determined analytically using linear least squares (See Eig.[^. 
Some of the attractive features of ELM include the universal 
approximation capability, better generalization, the convex 
optimization problem of ELM resulting in the smallest training 
error without getting trapped in local minima, availability of 
a closed form solution eliminating iterative training ina. 

Input Neurons 



Random 

Projection 


Eig. 5: Extreme learning machine model structure. 

ELM training involves solving the following optimization 
problem 

ii^{\\HW-Yf+ \\\Wf} (6) 

= =i){Wjx{k) + br) (7) 

where A represents the regularization coefficient, Y represents 
the vector of outputs, ip represents the hidden layer activation 
function (typically sigmoidal or radial basis functions) and 
Wr , W represents the input and output layer parameters re¬ 
spectively. Here, rih represents the number of hidden neurons 


of the ELM model and H represents the hidden layer output 
matrix. 

A prominent feature of ELM is that the nonlinear opti¬ 
mization problem is reduced to a linear parameter estimation 
problem. This reduction is made possible by the random 
assignment of the input layer parameters. The matrix Wr 
consists of randomly assigned elements that maps the input 
vector to a high dimensional feature space while br G 
is a bias component assigned in a random manner similar to 
Wr. The number of hidden neurons determine the dimension 
of the transformed feature space. The random parameters can 
be assigned based on any continuous random distribution ED 
and remains fixed during the training process. The intuition 
behind the random parametrization of ELM can be explained 
as follows. By assigning random weights as described above, 
along with an activation function, a regressor (j) with several 
functional combinations (with different order terms) of the 
input feature vector x is obtained. Eor a complex problem, 
more hidden neurons are required which can be thought of 
as introducing more complex feature mappings. When the 
dimension of the regressor (j) is sufficiently high with sufficient 
inclusion of higher order (nonlinear) features, it can be mapped 
to the outputs linearly. Hence the training reduces to a single 
step calculation given by equation (0. The ELM decision 
hypothesis can be expressed as in equation <0 


W* = + XI) ^ H'^Y. 

(8) 

f{x) = W^[j;{Wjx + br)]. 

(9) 


C. Model Development and Validation 

The engine experimental data is split into training and 
testing sets. The training set consists of about 16000 cycles 
of data while the testing set consists of about 7000 cycles. 
In order to validate multi-step ahead prediction performance, 
a separate MSAP-testing set containing about 2400 cycles of 
data is used. Eirstly, the model hyper-parameters are tuned 
using a cross-validation approach M, la is employed where 
a small subset of the training set is used to train the model 
with several combinations of hyper-parameters and testing its 
performance on the rest of the unseen training set. After tuning 
the model hyper-parameters using cross-validation, an optimal 
model structure is determined. The optimal HCCI engine 
model consists of 20 hidden neurons with a regularization 
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0 100 200 300 400 500 600 



(a) A 600 cycle ahead prediction results of the ELM engine model (unseen test 
data set 1). 



(b) A 600 cycle ahead prediction results of the ELM engine model (unseen test 
data set 2). 



(c) A 600 cycle ahead prediction results of the ELM engine model (unseen test (d) A 600 cycle ahead prediction results of the ELM engine model (unseen test 
data set 3). data set 4). 

Fig. 6: Multi-step prediction performance of the ELM HCCI engine model. The prediction is shown in red while the actual 
data is shown in blue. The corresponding model inputs (engine control inputs) such as FM, EVC and SOI are not shown as 
it is common to both prediction and actual data. 
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coefficient (A) of 0.001 and a system order (no) identified to 
be 1. The model is retrained with the optimal hyper-parameters 
and evaluated on an unseen test data set. The testing and 
MSAP-testing data sets are never seen by the models during 
training. 

The models developed in this section are intended for use 
in a predictive control framework where real time predictions 
are required in the engine ECU. In order to evaluate the 
prediction capability of the models, a root mean squared error 
(RMSE) given by equation is used. The models are trained 
using a series-parallel architecture and one-step ahead 
prediction performance is evaluated on the unseen testing data 
set. Einally, the model predictions are evaluated for Upred 
steps ahead in time using a separate input sequence. Both 
the testing set as well as the input sequence for multi-step 
ahead predictions are never seen by the model during training. 
This gives a good measure of the long term predictions as 
well as the generalization capability of the models to unseen 
situations. 


RMSE = 




N Vd 


-| ' if a 


Vj)^- 


*=i i=i 


( 10 ) 


The test RMSE for one-step ahead prediction is observed to be 
0.1085 while for a 600-step ahead prediction, the test RMSE 
is observed to be 0.1092. The predictions are summarized in 
Eig.j^to Eig.j^for different unseen MSAP-testing data sets. 
The RMSE values correspond to data normalized between -1 
and -\-l, and give a good indication of how well the model 
can predict the dynamics of the HCCI engine. The MSAP 
predictions at several different engine operating conditions as 
well as the MSAP RMSE values prove that the model can be 
used for predicting multiple steps ahead in time and can be 
used as a predictive model for the HCCI Engine in the MPC 
framework to be discussed in the next section IIVI 


IV. Predictive Control formulation using 
Extreme Learning Machines 

In this section, the MPC problem is formulated based on 
general predictive control principles ca, M for a class of 
nonlinear systems using ELM models. The formulation will 
be applied to the HCCI engine problem in the later sections. 
Consider a general class of nonlinear discrete time system, 

z{k + l) = f{z(k),u{k)) 

y{k) = g{z{k)), (11) 

where 2 ; G u G y G k the time index, n, m and p 
represent the number of states, inputs and outputs respectively. 
/(.) and g{.) are continuously differentiable and globally 
Lipschitz II 32 II nonlinear functions modeled offline using ELM. 
The models can be linearized around any operating point 
(zq^uq) using Taylor’s series expansion as follows 

z{k + l) = f{z°{k),u°{k)) + A{zik)-z°{k)) 

+B{u{k) - u°{k)) + ez,ho 
y{k) = g{z^{k)) + C{z{k) - z^{k)) + ty^ho 


A 

B 

C 


— {z{k),u{k)) 
^{z{k),u{k)) 


z^{k),u^{k) 

z^{k)^u^{k) 

z^{k),u^{k) 


where A, B and C represent the partial derivatives of the ELM 
models in the Taylor’s expansion, Cz^ho and Cy^ho represent 
higher order terms. The linearized model can be further written 
as 


z{k-\-l) = Az{k) ^ Bu{k) ^ di{k) 

y{k) = Cz{k)+d 2 {k) (12) 


di = f{z°{k),u°{k))-{Az°{k) + Bu°{k)) + ez^ho 
d 2 = g{z°{k),u°{k)) - Cz°{k) + Cy^ho- 

The following subsections describe the calculation of the sys¬ 
tem matrices A, B and C followed by the MPC optimization 
problem formulation. 


A. Calculation of System Matrices 

The matrices A^B and C in equation ([T2J can be de¬ 
termined by exploiting the structure of the ELM model as 
follows. Let the augmented input vector to ELM be given by 
x{k) = [u{k), z{k)]^ G The matrices A, B and C can 

be determined by calculating the Jacobian of /(.) and g{.) 
with respect to the augmented input vector x{k). The ELM 
model structure can be expressed as 

z{k + l) = W'^['4>{Wjx{k) + br)] (13) 

where represents the hidden layer activation function and 
Wr G W G represents the input and output 

layer parameters respectively. Here, rih represents the number 
of hidden neurons of the ELM model, 0(/c) = x{k) + 

hr) G represents the hidden layer output matrix as 

termed in literature (see Eig. [^. As mentioned earlier, the 
matrix Wr consists of randomly assigned elements that maps 
the input vector to a high dimensional feature space while 
6^ G is a bias component assigned in a random manner 
similar to Wr. The elements can be assigned based on any 
continuous random distribution ED and remains fixed during 
the learning process. The number of hidden neurons determine 
the dimension of the transformed feature space and the hidden 
layer is equipped with a nonlinear activation function similar 
to traditional neural network architecture. In this paper, a 
sigmoidal activation function is considered. 

Note that the ELM model in ( p^ is defined for inputs 
and outputs normalized to lie between [—1,-bl]. Expressing 
the model in OH* along with the normalization and de¬ 
normalization terms, 

, ( ^max ^min \ r, tttT m \ ^ 

Zmin + ( -^- \{1 + W^ 4 >{k)) 


z(k + l) = 

m = 
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Then, Jacobian matrix ^ can be derived (ignoring the time 
index k) as 


where 



(15) 


dXn 


2Wr{j, 


(x --x ■ (l + 


2 ’ 


Wr,i represents the column of Wr and br^i represents the 
jth elejnent of 6^, ^ G Since the augmented 

vector is defined as x{k) = [u{k), z{k)]'^, the matrices A and 
B can be extracted from the Jacobian ^ as 


'df 

dx 


nxn+m 


[-^nxm l^nxn] • 


(16) 


A similar Jacobian calculation can be done for 5 f(.) and also for 
other type of activation functions The above calculations 
are algebraic and can be efficiently performed online. 


where 


CB 

0 

CB + CAB 


CB + .. + CA^"-'^B . 

CB 

CB + .. + CA^^B 

CB + CAB 

_ CB + .. + CA’^y-'^B . 

. CBx\-..x\-CA^y-^^B _ 



CB 


r 1 


CB + CAB 

,Z = 

CA^ 


_ CB + CA^y-^B _ 


1 

0 

1 _ 



c 


Ip 

Vi = 

C + CA 

,% = 

Ip 


_ C + CA^y-^ _ 


. Ip - 


Ql G R^yP^^yP,Q2 G M^nmxAr^m^y ^ 

AU G R^yP^^.U G R^uPxN^m^ 

V ^ R^yP^rn^2 G R^yP^'^.Vi G ^ R^yP^P. 

The optimization problem in equation 0 can now be 
expressed in vector form as 


B. MFC Optimization Problem 

The goal of MFC is to force the system output y{k) track a 
given reference r{k) and also penalize any large excursion in 
the input signal u{k). This is obtained by solving the following 
optimization problem at every time instant k 

Nu-l 

^(^) = Mk+j\k)-yif^+jM\Qi+ 51 IAw(^+il^)llQ 2 

j=l j=0 

(17) 

{ amin — u{k^j\k) < 

"O^max 

^Umin < ^U{k + j\k) < AUmax (18) 

ymin — “1“ j|^) — Vruax 

where r{k + j\k),y{k + j\k)^Au{k + j\k) represents the 
reference, system output and control increment respectively. 
The argument {k-\-j\k) indicates the signal from time index k 
until k-\-j being used for solving the optimization problem at 
time index k. Here Au{k-\-j\k) = u{k-\-j\k)—u{k — l-\-j\k), 
Ny and Nu are prediction horizon (Ny > 1 ) and control 
horizon (0 < < Ny) respectively, ||.||qi and ||.||q 2 denote 

weighted Euclidean norm weighted by matrices Qi and Q 2 
respectively. The minimum and maximum constraints for u, 
Au and y are given as in equation (T^ . 

By defining the following vectors, 

Y{k) = [y{k + l\k),y{k + 2\k),..,y{k + Ny\k)f 
AU{k) = [Au{k\k), Au{k + 2\k),Au{k + Nu — l\k)]'^ 

R{k) = [r{k+l\k),r{k + 2\k),..,r{k +Ny\k)]'^ 

and calculating y{k+j\k) recursively using equation ( fT^ , the 
vector Y{k) can be expressed as 

Y{k) = Z{k)z{k) + U{k)AU{k) + V{k)u{k - 1) 

^Vi{k)di{k) AV2{k)d2{k) (19) 


min 

AU(k) 


{AY'^{k)QiAY{k) + AU'^{k)Q2AU{k)} 


where 


( 20 ) 


AY{k) = R{k) - Y{k) 

= R{k) - Z{k)z{k) - U{k)AU{k) 
-V{k)u{k-1)-Vi{k)di{k) 
-V2{k)d2{k). (21) 


Expressing as a quadratic programming problem, the above 
formulation reduces to 


min \ ]-AU'^(k)Wi(k)AUik) + WUk)AU{k)\ (22) 
AU(k) [2 J 


subjected to B(k) < F{k) (23) 


where 

lEi(fc) 

W2(fc) 

E{k) 


F{k) 


H 


2[U'^ (k)QiU{k) + Q 2 ] 

-2U’^{k)Qi[R{k) - Z{k)z{k) 

-V{k)u{k - 1) - Vi{k)di{k) - V 2 {k)d 2 {k)\ 
H - H U{k) -W(fc)]^ 
AUmax 
AUmin 
Umax Uk — 1 
(Umin — 1 } 

Ymax - Z{k)z(k) - V{k)u{k - 1) 
-Vi(k)dl(k) -V2{k)d2(k) 

-{Ymin - Z{k)z{k) - V{k)u{k - 1) 
-Vi{k)diik) - V2{k)d2ik)} 

' Im 0 . . 0 1 
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Ufnin 

Umax 

^Umin 

^Umax 

Uk-1 

Y 

^ min 
^m,ax 


= \U. 


min 

^max 


l • *^71 


r, • 


[^Umin 


= [Al 


AUn 


.AUn 


[u{k — 1) u{k — l)..u{k — 1)]^ 
\ymin ymin-'llminl 
[Vmax Umax "Umax] • 


Im, Ip and iNum represents identity matrices in 
]^pxp and respectively. The above problem can 

be solved using efficient quadratic programming solvers ns. 
The first value of the optimal control increment AU{k) is 
applied at the present time instant k and the optimization is 
solved again for the next time index. This is done to handle 
any model inaccuracies and external disturbances. 


V. Application to Control of a Gasoline 
Homogeneous Charge Compression Ignition 
Engine 

The goal of this section is to design a real-time control 
algorithm that can control the HCCI engine to track a given 
reference command in IMEP and CA50. The IMEP reference 
represents the driver’s load demand while CA50 reference is 
calculated a priori for achieving a sweet spot between high 
efficiency, low emissions and stability in combustion. The 
procedure for calculating reference IMEP and CA50 is outside 
the scope of this article and the reader is referred to 1 ^ . 
El. Eor the controller analysis considered in this paper, it is 
assumed that the reference commands are available and the 
goal is to determine the optimal control trajectories of PM, 
EVC and SOI that tracks the reference commands. 

The MPC framework is shown in Pig. |7] An offline trained 
nonlinear model of the HCCI engine, developed using ELM 
is used as a proxy for the HCCI engine. 


m section 


III 


At every operating point, the model is linearized and the 
system matrices are used to formulate a quadratic program as 


described in section IV The engine hardware limitations as 
well as operating constraints are included in the optimization 
problem. The reference command includes optimal set points 
of IMEP and CA50 that is to be tracked by the engine. At every 
time instant, the solver receives the present state information 
(z{k)) from sensor measurements and attempts several control 
trajectories of PM, EVC and SOI. The optimal trajectory that 
minimizes the tracking error and control excursion is given to 
the engine as input. 

As mentioned previously, the control knobs for the HCCI 
engine such as PM, EVC and SOI vary the amount of EGR 
trapped in the cylinder. The EGR influences the temperature 
and concentration of the mixture, affecting IMEP and CA50 
of the combustion event. The physical states of the system can 
include a combination of temperature, concentration, pressure 
of the gas mixture before combustion but a direct measurement 
of in-cylinder states is not feasible for production engines. 
In-cylinder pressure is the only available measurement from 


which input-output models were built in section III As a 


consequence, for the control problem considered here, the 
states, inputs and outputs of the system are given by 

z{k) = [IMEP{k) CA50{k) Pmax{k) 

Rmax{k) n{k) X{k)f 

u{k) = [FM{k) EVC{k) SOI{k)f e 
y{k) = [IMEP{k) CA50{k)f e 

The dynamic equations of the model can be expressed as in 
O- This system represents a nonlinear multi-input multi¬ 
output model structure which makes control design very 
challenging. Purther, the engine exhibits both system level 
and operation level constraints which makes traditional linear 
control methods such as PID, LQ etc. ineffective. Purther, 
additional challenges inherent to the HCCI engine include 
high noise amplitude levels, high sensitivity to disturbances, 
fast operation and tight tracking of the reference CA50. As 
mentioned earlier, an MPC based approach has sufficient 
leeway to handle the above challenges. 

MPC technology is well developed for linear systems 
with computationally efficient solvers. However, application of 
MPC to a nonlinear system such as the HCCI engine involves 
solving a quadratic programming subproblem iteratively at 
every time instant. To give an idea of the engine sampling 
period, a quadratic program problem needs to be solved every 
48 milliseconds when the engine operates at 2500 RPM. The 
non-availability of efficient solvers for sequential quadratic 
programming problem in real-time and the inability to guar¬ 
antee a global optimal solution for such problems constitute 
the major bottleneck for nonlinear MPC techniques. However, 
if the system is not highly nonlinear, a linearized model can 
be used to obtain suboptimal control laws in real-time using 
quadratic programming. A quadratic programming is relatively 
manageable than solving it sequentially for a constrained 
nonlinear programming problem and hence more suitable for 
online applications. However, for the considered high-speed 
engine application, there is very little time even for a simple 
but generic quadratic programming solver. In the next section, 
a fast quadratic programming approach is described that makes 
use of the problem’s strictly convex objective function to speed 
up convergence. 

A. Fast Quadratic Programming 

The MPC problem involves solving a quadratic program¬ 
ming subproblem of the form given by equation ^2) . The 
generic quadratic programming solver demands computation 
and memory owing to iterative interior point, active sets 
or trust region approximations and becomes infeasible for 
implementation on the engine ECU. In order to reduce the 
computation and memory, an efficient and fast QP algorithm 
is adopted EH- The algorithm can be derived as follows. 

Restating the MPC quadratic programming problem from 

min \-AU^{k)Wi{k)AU{k) + Wj{k)AU{k)\ (24) 
i\u(k) (2 J 


subjected to E{k)AU{k) — F{k) < 0 


(25) 
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Fig. 7: A model predictive control framework showing the use of offline trianed nonlinear engine model for reference tracking. 


where Wi{k) is a symmetric positive definite matrix and 
the objective function is strictly convex. The lagrangian dual 
problem can be formulated as 

maxinf \ l-AU'^{k)Wi{k)AU{k) + Wl{k)AU{k) 

+ XL{E{k)AU{k) - F{k))^ (26) 

where > 0. Taking the derivative with respect to AU, 

Wi{k)AU{k) + W2{k) + E^{k)XL=0. (27) 

The dual problem can be expressed as 

max j -AU'^{k)Wi{k)AU{k) + {k)AU{k) 

+ XL{E{k)AU{k)-F{k))^ (28) 

subjected to 

Wi{k)AU{k) + W2{k) + E'^{k)XL = 0 
y > 0. 

Since Wi{k) is positive definite, Wi{k)~^ exists and equation 
•HZ) can be solved as follows 

AU* = -Wi{k)-^{W2{k) + E^{k)XL). (29) 

Following a direct substitution of ([29]( in (|2^, the problem 
becomes 

+ AjAa - {k)W^\k)W2{k)\ 

(30) 

subjected to ^ > 0 (31) 

where Ai = -E{k)W^\k)E'^{k) and A 2 = -F{k) - 
E{k)Wi^{k)W 2 {k). The problem in ( |30l l can be solved using 
a simple gradient ascent method as follows. 

Aufe+i = ^Lk + ^Stepi-^I^L + A 2 ). (32) 


In order to satisfy the constraint in ( [3T| ), the following modi¬ 
fication is made 

^Lk+i = max{\Lk + Astep(AiAL + A 2 ), 0) (33) 

where \step defines the step size. The solution of ( [^ gives the 
optimal \\ which can be substituted in ( [^ to get the optimal 
MFC output Af/*. The strictly convex property of the MFC 
problem is made use of in solving the quadratic programming 
subproblem efficiently. 

B. Simulation Setup 

For the study considered here, the offline trained nonlinear 
model is considered as the true HCCI engine plant for which 
the MFC controller is designed. The goal of the controller is to 
track the reference IMEF and CA50 trajectories with minimum 
error and with minimum change in control input (see (p^). 
The reference trajectory is designed offline depending on the 
allowable operating regions of HCCI and the valid region of 
the HCCI engine model. The step references are designed to 
vary between 2.6 and 3.2 bar IMEF and between -4 and -10 
deg CA50 defined in degrees before combustion TDC. This 
covers most of the naturally aspirating HCCI operating range 
at 1800 RFM. The MFC constraints are defined as follows. 
It should be noted that the objective function and constraints 
can be modified in a straightforward manner to include more 
performance metrics such as emissions, combustion roughness, 
knock levels etc. 


'^min 

[19 - 121 272]^ 

'^max — 

[25 - 100 375]^ 


[-6 - 22 - 103] 


[6 22 103]^ 

ymin — 

[2.1 - 14]^ 

Vniax ~ 

[3.55 - 2f. 

C. High Amplitude Noise 

of HCCI 


As mentioned earlier, combustion phasing is an important 
quantity that indicates engine performance. Combustion is not 








































IN REVIEW, SPECIAL ISSUE ON NEURODYNAMIC SYSTEMS EOR OPTIMIZATION AND APPLICATIONS. 


II 


IMEP =3.26 IMEP =3 IMEP =2.63 IMEP =2.88 



CA50 =-8.93 CA50 =-7.45 CA50 =-7.87 CA50 =-8.55 



Fig. 8: Noise characteristics of CA50 (top rows) and IMEP (bottom rows) as observed in the HCCI engine experimental data 
for different operating conditions. 


an instantaneous process but extends over a period of time. 
Significant research has been done in determining an appro¬ 
priate parameter that summarize the combustion event and 
that has good indication over phasing |6|, (71. It was widely 
accepted that CA50 was a robust indicator for combustion 
phasing. However, CA50 is characterized by a highly random 
process involving noise in the in-cylinder pressure measure¬ 
ments, variability in gas mixing, heat transfer, difference in 
cylinder-to-cylinder design and cycle-to-cycle variations 
CD, El. As a consequence, the variability in CA50 is high. 
The IMEP is a more averaged effect of the pressure charac¬ 
teristics in the cylinder and thus its variability is lesser. The 
noise distribution of IMEP and CA50 at certain representative 
operating conditions are summarized in Fig. It can be seen 
that the noise is almost Gaussian with zero mean. The top rows 
represent noise in CA50 signals at different IMEP conditions 
while the bottom rows represent noise in IMEP measurements 
at different CA50 conditions. The MPC framework considered 
in this work involves linearization of the models at every 
operating point defined by sensor measurements. In order 
to simulate the controller’s robustness to the high amplitude 
noise seen in HCCI engine measurements, white noise signals 
of zero mean and variances 0.0012 and 1.76 are injected 
at the outputs of the IMEP and CA50 model respectively 
and the models are linearized around the noisy measurements 
experienced in real engine operation. 


D. Results And Discussion 

In this section, the results of the ELM based MPC results 
are summarized. A simulation is conducted with a Matlab real¬ 
time target bypassing communication with the engine ECU. 
The ELM model is observed to compactly represent the HCCI 


engine with about 320 parameters (Wr G ,br G 

W G This compactness in comparison to earlier 

neural network and SVR models is significant ID, ID for 
the MPC application. Eurther, the fast quadratic programming 
approach enabled online implementation of the MPC. At every 
simulation step, the inputs and outputs of the engine model 
are available as sensor measurements to the MPC system. The 
HCCI model is linearized around sampled states and is used 
in the online MPC algorithm to determine the optimal control 
increment (Af/*), i.e., the optimal fuel mass, EVC and SOI to 
be given to the engine to track the reference commands. After 
performing several trial and error simulations, the prediction 
and control horizons take values Ny = 3 and Nu = 3, tuned 
for minimum tracking error. Similarly, the gain matrices are 
tuned to be 


Qi = 
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tracking error while the even diagonal values correspond to 
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(a) State trajectories of the HCCI engine model (with noise) using MPC control (b) Control trajectories of the HCCI engine model (with noise) using MPC 
(case 1: constraint on Rmax not enforced in the MPC formulation). control (case 1 constraint on Rmax not enforced in the MPC formulation). 

The upper and lower limits of each actuator is shown in dotted red. 
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(c) State trajectories of the HCCI engine model (with noise) using MPC control (d) Control trajectories of the HCCI engine model (with noise) using MPC 
(case 2 constraint on Rmax enforced in the MPC formulation). control (case 2 constraint on Rmax enforced in the MPC formulation). The 

upper and lower limits of each actuator is shown in dotted red. 

Fig. 9: Evaluation of MPC controller using HCCI engine simulator. 
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reducing CA50 tracking error. The relative difference in values 
between IMEP and CA50 indicates the relatively high noise 
level of CA50 and a smaller weight trying to track the noisy 
CA50 less aggressively. Q 2 is tuned to avoid saturation of the 
input signals (taken as constraints in the MPC formulation). 
The gain corresponding to FM is high indicating a large 
excursion in FM is penalized so that fuel mass is slowly varied. 
This is done to ensure that both FM and SOI from reaching 
their actuator limits. 

To evaluate the MPC performance, a reference command 
involving a series of random steps of IMEP and CA50 is 
considered. The step input to the controller can be thought 
of as shifting the engine from one set point to another and 
gives a good idea of the control performance in terms of 
response speed, transient and steady state performances. It can 
be observed from Fig. that the controller is able to track 
the considered reference. The time taken by the controller to 
switch the engine from one set point to the next is about 5 
cycles for a small step to about 20 cycles for a large step. By 
tuning the MPC gains further, the transients of the controller 
can be shaped to tradeoff between quickness in response to 
overshoot and minimum oscillations around the reference. 
Care must be taken while tuning the gains so that the controller 
does not saturate the actuators or violate the constraints. Also 
from Fig. the transients of the other states of the engine 
including Pmax, Rmax^ engine brake torque and fuel richness 
in the mixture can be observed. These quantities are obtained 
from the HCCI engine model for the optimal MPC control 
trajectories. The control inputs (optimal trajectories) of MPC 
such as FM, EVC and SOI can be seen in Fig. It can be 
observed that none of the actuators violate the specified limits. 

In the above simulation, the constraints are specified only 
for the actuators and output variables such as IMEP and CA50. 
However in real situations, typically the engine operation is 
constrained between stability limits such as misfire, knock 
and ringing. In order to analyze MPC performance with state 
constraints and stability limits, an additional constraint is 
defined on Rmax- In Fig. 9a the maximum rate of pressure 
rise (Rmax) exceeds 3.5 bar/deg CA(shown by red dotted line). 
By including this as a state constraint in the MPC formulation, 
the second simulation is performed. The MPC performance 
is summarized in Fig. and Fig. It can be observed 
that the MPC control is modified so that the engine Rmax 
is less than 3.5 bar/deg CA. A direct comparison of the MPC 
control trajectories in Fig. and Fig. [9d| shows that when the 
constraint on Rmax is active, MPC reduces the SOI command 
to operate the engine with less pressure rise rates for the given 
IMEP and CA50 reference commands. This summarizes the 
capability of the proposed approach to compute a solution 
for the multi-input multi-output control problem in an optimal 
manner. It has to be noted that, as the constraint is active, it 
becomes difficult for MPC to achieve close tracking as the 
available freedom is restricted by the active constraint. By 
tuning the gains further, a better tracking may be achieved. 

Finally, in order to simulate the engine demands in a vehicle 
application, a slowly varying sinusoidal reference command 
is given both for IMEP and CA50. This is to simulate the 
engine power demand while accelerating and slowing down 


repeatedly. The control performance is summarized in Fig. 


10a and Fig. IQb It can be observed that the MPC tracks the 


given reference to a good degree of accuracy with constraint 
satisfaction. Hence, the above simulation cases demonstrate 
the working of EFM based MPC, its manageable computa¬ 
tional complexity and its overall potential for real time HCCI 
engine control. 


VI. Conclusions and Future Work 

HCCI engine control is a nonlinear, multi-input multi-output 
problem with state and actuator constraints which calls for 
advanced control designs. In this paper, a model predictive 
control approach has been demonstrated that tracks multiple 
reference quantities along with constraints on HCCI states and 
control inputs. 

A nonlinear system identification is performed using ex¬ 
treme learning machines and HCCI engine models are de¬ 
veloped using experimental data. EFM models are shown to 
compactly represent the nonlinear dynamics of HCCI and can 
be used for predicting several steps ahead of time for opti¬ 
mization purposes. An analytical derivative calculation using 
the structure of EFM models is used which can avoid issues 
associated with numerical derivatives. The MPC optimization 
is formulated as a convex problem for which a fast quadratic 
programming method is used. Simulation studies have been 
conducted to demonstrate the working of EFM based MPC 
for the considered HCCI engine problem. 

In summary, this article demonstrates a computationally 
feasible approach to perform MPC for HCCI engines using 
a nonlinear model in real-time. Future work would focus on 
extending the method to develop controller for the experimen¬ 
tal engine and reformulating MPC to include vehicle level 
objectives such as fuel economy and emissions. 
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Fig. 10: Evaluation of MPC controller using HCCI engine simulator. 
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